word rank | frequency | word |
---|---|---|
1 | 6578 | ning |
2 | 4976 | siis |
3 | 4119 | pole |
4 | 3494 | seda |
5 | 3036 | kuid |
word rank | frequency | word |
---|---|---|
1 | 1810 | pärast |
2 | 1686 | aastal |
3 | 1595 | midagi |
4 | 1519 | rohkem |
5 | 1471 | tagasi |
word rank | frequency | word |
---|---|---|
1 | 1543 | Tallinna |
2 | 886 | inimesed |
3 | 869 | võimalik |
4 | 777 | lihtsalt |
5 | 531 | vähemalt |
word rank | frequency | word |
---|---|---|
1 | 499 | tegelikult |
2 | 316 | tähelepanu |
3 | 237 | presidendi |
4 | 159 | Kuressaare |
5 | 159 | inimestele |
word rank | frequency | word |
---|---|---|
1 | 226 | avaldamiseks |
2 | 192 | tõenäoliselt |
3 | 191 | Keskerakonna |
4 | 83 | kommenteeris |
5 | 82 | esmakordselt |
word rank | frequency | word |
---|---|---|
1 | 105 | pressiesindaja |
2 | 90 | rahvusvahelise |
3 | 79 | Reformierakond |
4 | 68 | Eesti Ekspress |
5 | 65 | linnavalitsuse |
Slope |
---|
-1.1037498616536525 |
Slope |
---|
-0.7785668433161497 |
Slope |
---|
-0.6483325951307655 |
Slope |
---|
-0.5586356478278822 |
Slope |
---|
-0.5246090113350907 |
Slope |
---|
-0.7196663469151313 |
The validity of Zipf’s law for all words does not imply its validity for words of fixed length. The tables show the most frequent words for fixed word lengths 4, 6, 8, …, 14.
The diagram implies that Zipf’s law is still valid, at least for larger word length.
The diagrams are interesting for language comparison. In the case of a diagram of very different shape there might have been problems in preprocessing which should be visible elsewhere. Or, more interesting, there might be special features inherent to this language.
For length 8:
SELECT freq ,word FROM words WHERE w_id>100 and char_length(word)=8;
Explain why we see better agreement with Zipf’s law for larger word length.
Zipf’s law (Classic version)